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The  purpose  of  this  study  was  to  test  the  effects 
of  using  a  tri-inf ormant  feedback  procedure  in  a  group 
counseling  setting.     Behavioral  feedback  from  the  coun- 
selor,  the  client  and  the  client's  nominated  significant 
others  were  the  independent  variables.     Movement  toward 
or  away  from  a  client's  goal  as  perceived  by  the  client 
himself,  his  nominated  significant  other  and  his  coun- 
selor were  the  dependent  variables.     The  Automated  Tri- 
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informant  Goal  Oriented  Notation  (ATGON)  was  used  to 
collect  goal  information  and  to  generate  feedback  print- 
outs.    Subjects   (N=53)  were  selected  from  a  community 
mental  health  population  and  randomly  assigned  to  one 
of  three  treatment  or  three  control  groups.     The  experi- 
mental groups  received  behavioral  feedback  information 
in  the  form  of  ATGON  printouts  while  the  control  groups 
received  only  group  counseling. 

The  treatment  period  was  ten  weeks  and  included 
two  group  sessions  per  week.     The  experimental  design 
was  a  pretest-posttest  control  group  design.  One-way 
analyses  of  variance  were  used  to  test  for  differences. 
Significant  differences  were  further  analyzed  by  Tukey's 
HSD  test.     Although  clients  and  their  significant  others 
did  not  discern  significant  differences  in  client's 
behavior  between  pre  and  posttesting,  the  group  coun- 
selors did.     These  results  showed  counselors  perceiving 
more  positive  change  than  clients  or  the  client's  sig- 
nificant others.     This  suggests  that  counselors  may  be 
cued  to  minute  changes  and  more  sensitive  to  them.  One 
explanation  of  these  results  is  that  there  was  not  enough 
treatment  exposure  time  for  the  clients  and  significant 
others  to  discern  changes.     Another  is  that  counselors 
could  have  been  fulfilling  their  own  prophecy  to  be 
helping  clients  and  observing  positive  change  that  did 
not  occur. 

« 
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Chapter  I 
Introduction  and  Background 

The  value  of  feedback  in  counseling  is  that 
it  often  gives  an  individual  client  an  awareness 
of  certain  negative  behaviors  that  may  be  causing 
him  to  malfunction  in  reality.     The  feedback  infor- 
mation permits  him  to  make  adjustments  and  decisions 
regarding  the  possible  modification  of  this  behavior. 
Client-centered  counseling,  behavioral  counseling, 
Gestalt  therapy,   encounter  therapy,  and  transactional 
analysis  use  some  form  of  feedback  in  their  particular 
orientations  (Rogers,   1951;  Lazarus,  1967,  1972;  Perls 
1969;  Carkhuff  and  Berenson,  1967;  Egan  1970;  Berne, 
1966) . 

Feedback  is  a  term  borrowed  from  the  engineering 
sciences  meaning  a  servo-mechanism  that  controls  it- 
self (Karlins  and  Andrews,   1972).     More  specifically, 
it  took  on  the  meaning  of  a  "kind  of  reciprocal  inter- 
action between  two  or  more  events  in  which  one  action 
generates  a  secondary  action  which  in  turn  redirects 

1 


the  primary  action"  (Smith  and  Smith,  1966,  p.  203). 
The  feedback  process  is  an  accepted  communications 
principle  in  general  systems  theory  and  in  the  science 
of  cybernetics  (Wiener,   1948;  von  Bertalanffy  1966, 
1968). 

Feedback  is  a  circuit  with  three  distinct  segments. 
In  the  first  segment  there  is  a  movement  in  a  defined 
direction.     In  the  second  segment  there  is  a  comparison 
of  this  movement  with  true  movement  and  direction, 
plus  the  generation  of  an  error  signal  if  there  is  a 
difference.     In  the  last  segment  the  error  signal  is 
fedback  into  the  origination  system  thus  enabling  it 
to  use  the  new  information  to  correct  itself. 

Von  Bertalanffy  (1966,  p.   708)  diagrammed  this 
feedback  circuit  in  the  following  manner: 
Stimulus  Message  Message  Response 


Von  Bertalanffy  related  this  to  living  organisms  and 
felt  that  it  directed  the  organism  toward  a  goal  with 
constant  monitoring  via  the  feedback  loop.     This  per- 
mitted the  organism  to  more  closely  approximate  its 
defined  goal. 

In  the  feedback  process  the  error  signal  must  be 
clear  and  unequivocal  to  allow  the  system  to  integrate 
the  new  information  into  its  repertoire.     In  the  coun- 


.Receptor 


Control 
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^  Effector 


Feedback  loop 


seling  theories  cited  previously  such  equivocal  and 
global  terms  of  feedback  are  used  so  that  the  indi- 
vidual system  does  not  receive  a  clear  and  operable 
message.     Feedback  in  the  form  of  "change  your  per- 
sonality" or  "improve  your  self -concept"  lack  speci- 
ficity and  are  usually  stated  in  nonoperational  terms. 
Further,   there  is  a  general  failure  in  these  counseling 
theories  to  adequately  define  goals  in  percise  and 
quantifiable  terms  for  each  client  (Ohlsen,  1970). 
There  is  an  important  need  to  delineate  the  goals  for 
the  client  so  that  both  he  and  the  counselor  can 
appraise  the  effectiveness  of  the  counseling  process. 
These  questions  must  be  answered  to  permit  the  client 
and  counselor  to  judge  if  counseling  is  in  itself 
necessary  or  should  be  discontinued. 
The  Problem 

As  a  result  of  advances  in  the  field  of  cybernetic 
behavioral  research  and  the  use  of  computers,  social 
scientists  are  now  able  to  organize  and  simplify  large 
quantities  of  information  useful  to  the  counseline  pro- 
cess.    This  permits  the  helping  professional  to  process 
and  feedback  information  into  the  counseling  session 
that  might  be  obscured  or  lost  during  counseling. 
Multiple  sources  of  information  has  also  been  used  to 
confirm  similar  behavioral  observations.     The  feedback 
effect  of  multiple  observations  has  generally  strengthen 
the  validity  of  single  observations. 


This  study  used  a  client's  own  goals  as  the  criteria 
for  his  change  in  the  counseling  process.     These  goals 
were  specified  by  the  client  in  advance  of  the  treat- 
ment and  were  stated  in  behaviors  that  permitted  a  quanti- 
tative measurement  to  determine  if  change  was  significant 
from  pre  to  post  treatment. 

This  study  also  tested  the  effects  of  an  automated 
feedback  procedure  on  a  client's  goal  attainment  in 
counseling.     It  examined  the  effects  of  other  informant's 
perceived  goals  for  the  client,  that  is,  the  goals  per- 
ceived by  the  counselor  and  the  client's  selected  sig- 
nificant other.     The  counselor,   the  significant  other, 
and  the  particular  client  had  an  opportunity  to  reg- 
ister goals  as  seen  as  positive  for  the  client  and  each 
rated  the  client's  progress  toward  those  goals. 

This  study  recorded  behavioral  information  into 
a  format  that  can  be  easily  reintroduced  into  the 
counseling  session  and  thus  kept  as  a  baseline  record 
to  determine  counseling  outcome  effectiveness. 

This  study  obtained,  in  systematic  manner,  goals 
from  three  informants  yielding  a  large  quantified 
pool  of  information  concerning  the  client's  behavior. 
These  quantified  goal  statements  were  used  by  the 
clients  as  a  yardstick  to  mark  their  progress  toward 
their  goal  attainment.     The  feedback  printout  was  the 
treatment  variable  in  this  study.     It  was  the  intent 
of  the  experimenter  to  examine  the  effects  of  intro- 
ducing this  behavioral  information  into  a  group  coun- 
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seling  setting. 

This  study  attempted  to  answer  the  following  ques- 
tions . 

1.  What  would  be  the  effect  of  a  self -generated 
automated  feedback  system  with  regard  to  a  client's 
goal  attainment  in  counseling? 

2.  Would  feedback  assist  a  client  to  focus  on 
specific  problems  enabling  him  to  achieve  his  personal 

counseling  goals? 

3.  What  would  be  the  effects  of  other  informant's 
goals,  those  of  the  counselor  and  significant  other,  on 
a  client's  goal  attainment  in  counseling? 

The  above  questions  are  stated  in  null  hypothesis 
form  in  Chapter  III. 

Definition  of  terms  used  in  the  study 

Client  goals  -  a  specified,  objectively  observable  result 
of  a  client's  motivation  for  seeking  treatment.  These 
goals  are  enumerated  during  the  intake  process  and  were 
the  dependent  variables  in  this  study,  they  were  trans- 
lated into  goals  statements  e.g.  "to  suppress  or  reduce 
my  withdrawn  behavior,  to  increase  my  verbal  inter- 
actions with  my  spouse." 

Tri- informants  -  refers  to  the  three  individuals  par- 
ticipating in  the  formulation  of  goals  and  the  subse- 
quent rating  of  their  attainment  for  the  client.  The 
three  informants  were  the  client,  his  nominated  sig- 
nificant other  (usually  a  parent  or  spouse) ,  and  the 
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counselor 

Feedback  -  defined  as  information  about  the  effects  of 
one's  behavior  (Attneave,  1959).     Refers  in  this  study 
to  the  information  concerning  goals  and  goal  attainment 
obtained  from  the  three  informant  sources.  Feedback 
was  the  independent  variable  and  was  introduced  into  the 
counseling  setting  in  the  form  of  the  ATGON  printouts 
(appendix  D) . 

Goal  attainment  -  refers  to  the  perceived  movement  toward 
or  away  from  a  specified  goal.     A  Likert-type  scale  is 
used  to  measure  attainment  and  ranges  from  (1)  "much 
further  from  goal"  to   (2)  "sufficant  attainment  of  goal" 
with  (3)  equal  to  "no  change." 

Success  scores  -  a  computed  ratio  of  the  actual  impor- 
tance of  a  client's  goal  times  the  actual  attainment 
plus  ten  over  the  maximum  importance  times  the  maximum 
attainment  plus  ten.     Range  of  success  scores  are  from 
0.00  to  1.00  with  0.40  indicating  "no  change."  Scores 
greater  than  0.40  indicated  progression  toward  a  stated 
goal  and  scores  less  than  0.40  a  regression  from  the 
goal. 


Chapter  II 
■Review  of  the  related  literature 

Most  of  the  feedback  research  found  in  the  lit- 
erature is  in  the  area  of  physiological  feedback.  This 
type  of  feedback  deals  with  the  spacial  displacement  of 
information  using  television,  videotape,  mirrors,  and 
computers.     Other  feedback  research  has  dealt  with  the 
temporal  delay  of  feedback  information  such  as  slowing 
down  the  rate  of  infoirmation  or  intervening  with  the 
feedback  circuit.     Most  of  the  experiments  have  had  the 
subject  perform  a  task  while  the  experimenter  displaced 
or  delayed  the  feedback  to  observe  the  effects  on  the 
subject. 

Stratton  (1896,  1899),  one  of  the  earliest  exper- 
imenters in  feedback  research,  used  optical  displace- 
ment of  a  subject's  visual  field  to  alter  the  feed- 
back circuit.     He  used  a  specially  designed  pair  of 
glasses  to  invert  the  image  the  subject  received  as  a 
demonstration  that  space  perception  is  a  learned  activity. 
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Controlled  experiments  on  auditory  feedback  delay 
(Lee,  1950,  1951)  have  been  used  to  test  the  effects  on 
a  subject  of  slowing  down  the  feedback  of  his  own  words. 

More  recently  computers  have  been  used  as  the  inter- 
vening variable  to  alter  the  feedback  before  it  is  re- 
ceived by  the  subject.     Computers  have  the  ability  to 
manipulate  the  feedback  information  by  delaying,  scram- 
bling, slowing,  modulating,  and  changing  the  volume 
(Smith,  Mysciewski,  Mergen  and  Koehler,  1963).  The 
reliance  on  feedback  has  been  clearly  established  in 
the  research.     Alterations  in  the  feedback  circuit  has 
produced  behavioral  breakdowns  in  which  the  individual 
finds  it  difficult  to  carry  out  the  simplest  of  tasks 
(Smith  and  Smith,  1966). 

Videotape  feedback  has  been  used  as  a  counseling 
tool  for  the  past  thirty  years.  One  of  the  first  to 
use  this  type  of  feedback  was  Moreno  in  1942  (Kaplan 
and  Sadock,  1971) .  Since  then  a  great  deal  has  been 
written  about  using  videotape  feedback  in  counseling 
groups  (Alger  and  Hogan,  1967;  Berger,  1971;  Stoller, 
1969). 

Videotape  feedback  provides  the  client  with  the 
opportunity  for  information  in  the  form  of  a  "second 
chance  phenomenon"  and  has  the  effect  of  "image  impact." 
This  immediacy  of  impact  is  one  of  the  strongest  ele- 
ments of  this  visual  feedback  (Alger  and  Hogan,  1967: 
Alger,   1969a,  1969b). 


9 


Many  schools  of  counseling  have  incorporated  the 
feedback  principle  in  their  theoretical  approach. 
Psychodrama  (Moreno,  1969),  role  play  (Corsini,  1967), 
Gestalt  (Perls,  1969),  transactional  analysis  (Berne, 
1961)  and  behavioral  training  (Serber,   1972)  use  feed- 
back as  a  method  of  focusing  attention  on  the  behavior 
of  the  client  in  the  group  counseling  milieu. 
Feedback  theory  of  behavior 

According  to  Smith  and  Smith  (1966)  feedback  theory 
emphasized  the  importance  of  self -regulation  of  the 
client's  own  behavior  after  he  has  been  provided  with 
the  correct  information  on  which  to  make  decisions.  Feed- 
back theory  holds  that  individuals  possess  the  skills  and 
resources  in  V7hich  to  keep  themselves  integrated  in  social 
situations,  but  sometimes  there  is  an  interruption  of  the 
feedback  circuit  which  gives  the  individual  incorrect  in- 
formation on  which  to  base  his  decisions.     Increasing  a 
client's  correct  feedback  will  increase  his  ability  to 
self -regulate,  thus  improving  his  social  adaptation. 

The  feedback  process  is  most  powerful  in  groups  where 
one  can  try  out  new  behaviors  and  receive  direct  feedback 
from  others.     In  the  group  setting  the  individual  can  also 
receive  consensual  validation  or  invalidation  of  his  be- 
havior. 

Smith  and  Smith  (1966)  distinguishes  between  feed- 
back and  the  learning  theory  concept  of  reinforcement. 
He  feels  that  all  feedback  is  directly  related  system- 
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atically  to  the  reference  response  and  that  reinforcement 
need  not  be  related  to  the  response  it  reinforces.  Rein- 
forcement is  related  instead  to  the  drive  which  it  reduces 
or  the  motive  which  it  satisfies.     For  the  purposes  of 
this  study  this  distinction  will  not  be  made  since  the 
question  is  not  sufficiently  clear  as  to  what  comprises 
reinforcement  and  feedback  research  literature  use  the 
terms  interchangeable. 
Behavioral  feedback  literature 

In  a  recent  well  controlled  study,  McFall  and  Marston 
(1970)  demonstrated  the  effectiveness  of  assertiveness 
training  in  groups  by  using  behavioral  rehearsal  and 
feedback.     The  subjects  were  divided  into  two  groups, 
one  receiving  feedback  and  the  other  not  receiving  feed- 
back.    Behavioral  rehearsal  feedback  proved  to  hold  the 
highest  treatment  effect.     In  a  follow-up  study,  McFall 
and  Twentjmian  (1973)   supported  the  original  results  with 
the  use  of  rehearsal  modeling,  coaching,  and  feedback. 

Stuart  (1971)  evaluated  the  feasibility  of  changing 
the  communication  pattern  between  delinquents  and  their 
parents  using  a  feedback  system.     Although  his  experi- 
mental subject  number  was  small   (n=4) ,  he  found  support 
for  further  investigation  with  the  use  of  systematic 
feedback  in  an  effort  to  increase  the  rate  in  which 
delinquents  and  their  families  emit  positive  feedback. 
Further  support  for  the  use  of  the  positive  feedback  to 
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increase  the  prosocial  responses  of  delinquents  has  been 
found  by  Slack  (1960) ,  Johns  and  Quary  (1962) ,  and 
Schwitzegebel  (1967). 

Feedback  research  and  results  throughout  the  lit- 
erature have  been  diverse.     Experimenters  have  used 
lights  and  loud  noises  to  modify  the  behavior  of  diag- 
nosed organic  subjects  and  have  found  significant 
amounts  of  success   (Stone,   1966).     Similarly,  Wahler 
(1969)  found  that  he  could  modify  the  behavior  of  sub- 
jects' responses  by  administering  feedback  in  the  form 
of  auditory  signal  clicks.     Oakes,  Dorge,  and  August 
(1961)  found  visual  feedback  signals,  in  the  form  of 
lights,   to  be  effective  in  modifying  the  group  inter- 
actional behavior  of  individuals.     This  type  of  feed- 
back was  later  substantiated  by  Oakes  (1962)  and  Hasdorf 
(1965) .     McNair  (1957)  used  a  similar  procedure  to  dem- 
onstrate the  successful  modification  of  verbal  behavior 
in  his  subjects. 

Feedback  in  the  form  of  specific  information  has 
been  used  with  success  in  numerous  studies.     This  knowl- 
edge of  results  about  the  duration  of  self-applied 
exposure  to  a  noxious  stimulus  has  been  used  by  Leiten- 
berg,  Agarar,  Thompson  and  Wright  (1968)  to  modify  the 
behavior  of  phobic  clients. 

In  the  realm  of  children's  behavioral  problems, 
feedback  has  had  its  most  remarkable  effects  (Bernal, 
1969;  Hawkins,  Peterson,   Schweid  and  Bijou,  1967; 
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Lindsley,   1966;  O'leary,  O'leary  and  Becker,  1967; 
Patterson  and  Guillon,  1968;     Patterson  et  al.  1970; 
Werry  and  Wollersheim,   1967;  Wahler,  Winkel ,  Peterson 
and  Morrison,   1965).     Feedback  has  also  been  used  in 
marriage  counseling  dealing  with  the  behavioral  inter- 
actions of  marrieds  (Knox  and  Madsen,  1969;  Lazarus, 
1968;  Liberman,  1970). 

It  can  be  observed  that  a  large  amount  of  research 
has  been  marshalled  in  studying  the  effect  of  behav- 
ioral feedback.     This  study  intends  to  build  upon  this 
previous  research  and  extend  it  to  include  multiple 
criterion  measures. 
A  pilot  study 

Aikin  and  Lund  (1974)  conducted  a  study  using  the 
ATGON,   the  instrument  used  in  this  research,  at  the 
partial  hospital  (New  Da\^m)   in  Gainesville,  Florida. 
The  study  was  for  the  Florida  Consortium  for  the  Study 
of  Community  Mental  Health  Evaluation  Techniques. 
Using  the  New  Dawn  staff,   including  the  writer,  the 
authors  followed  the  progress  of  nineteen  clients  with 
the  automated  tri-inf ormant  goal  system.     Each  rater 
(client,   significant  other,  and  counselor)  chose  a 
number  of  goals  for  the  client  and  rated  the  client's 
attainment  on  each  goal  over  time.     The  results  showed 
the  counselors  selected  98  goals  and  had  a  mean  goal 
attainm.ent  rating  of  8.87  and  a  mean  success  score  of 
.58  for  each  client.     Attainment  ratings  are  on  a  six- 
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point  scale  ranging  from  (1)  "much  further  from  goal" 
to  (6)  "sufficient  attainment  of  goal"  with  (3)  indi- 
cating "no  change."    Mean  success  scores  range  from 
0.00  to  1.00,  with  0.40  indicating  "no  change."  Less 
than  0.40  is  regression  from  a  stated  goal  of  the  client. 
Clients  selected  112  goals  and  had  a  mean  attainment 
rating  of  4.31  and  a  mean  success  score  of  .67  for  each 
goal.     Only  one  significant  other  responded  selecting 
8  goals  with  a  mean  goal  attainment  rating  of  5.00  and 
a  mean  success  score  of  .81  for  each  goal.     These  data 
indicate  that  clients  were  reporting  a  significantly 
higher  degree  (z=4.68,  p.    <^.01)  of  attainment  than 
reported  by  counselors  in  both  mean  goal  attainment  and 
mean  success  socres. 

Although    the  number  of  subjects  is  relatively 
low,  particularly  significant  others,   the  results  de- 
monstrated a  need  for  further  investigation  using  the 
ATGON  instrument. 

Research  concerning  the  use  of  informants  in  counseling 

The  question  of  who  is  the  best  source  of  infor- 
mation on  the  progress  of  a  client  has  generated  much 
debate  in  the  counseling  field.     Biases  can  be  intro- 
duced when  relying  on  the  counselor's  own  evaluation  of 
the  effectiveness  of  his  counseling.     His  personal 
investment  in  the  process  can  be  highly  subjective. 
Conversely,   the  counselor  may  be  in  a  position,  based 
on  his  training  and  experience,   to  be  the  best  judge  of 
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client  progress.     This,  added  to  the  fact  that  the  coun- 
selor sees  the  client  over  a  period  of  time,   lends  sup- 
port for  the  counselor  as  a  criterion  of  effective  coun- 
seling.    Arguing  against  this  position,  Zax  and  Klein 
(1960),  Kiesler  (1966),  and  Maher    (1970)  believe  the 
counselor's  judgement  concerning  the  effect  of  the  coun- 
seling process  should  be  examined  carefully  because  of 
inherent  biases. 

Others  argue  that  the  client  is  in  the  best  position 
to  evaluate  the  effectiveness  of  the  counseling  process 
since  he  is  the  consumer.     This  viewpoint  has  merit  since 
the  client  is  in  a  phenomenological  position  to  give  a 
self-report.     Conversely  the  client  may  also  be  the  in- 
dividual with  the  most  investment  in  the  process.  This 
places  him  in  a  position  which  it  might  be  difficult  for 
him  to  admit  that  a  treatment  process  is  not  working  or 
that  he  is  not  achieving  his  goals  in  counseling.  Zax 
and  Klein  (1960)  and  Farnsworth  (1966)  argue  effectively 
against  the  use  of  the  client  as  the  one  source  of  infor- 
mation concerning  treatment  effectiveness. 

The  "significant  other"  has  been  introduced  as  an 
informant  (Wilson,  Ellis,   Booth  and  Mumpower,   1973).  The 
rationale  is  that  this  individual  sees  the  client  daily 
out  of  the  counseling  setting  and  can  give  a  more  com- 
plete and  accurate  picture  of  the  client's  behavior. 
The  significant  other's  investment  may  not  be  as  sub- 
jective as  either  the  counselor  or  the  client,  although 
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it  will  certainly  not  be  totally  objective.     Support  for 
the  use  of  the  significant  other  is  given  by  Small, 
Small  and  Gonzales,   (1965);  Katz  and  Lyerly  (1963)  and 
Vestre  and  Zimmerman  (1969) .     The  case  against  the  use 
of  any  one  informant  as  a  source  of  information  is  pre- 
sented by  Strupp  and  Luborsky  (1962). 

Perhaps  the  strongest  alternative  would  be  the  use 
of  all  three  informants  as  a  multiple  criterion.     When  a 
observation  has  been  confirmed  by  two  or  more  similar 
observations  the  validity  of  the  original  observation  is 
greatly  strengthened.     This  triangulation  of  measurement 
(Webb,  Campbell,   Schwartz  and  Sechrest,   1966),  using  the 
client,  his  nominated  significant  other,   and  his  coun- 
selor holds  more  support  for  the  validity  of  their  ob- 
servations over  a  single  criterion. 

In  summary,   the  effectiveness  of  feedback  as  an  inde- 
pendent variable  in  research  has  been  supported.  Behav- 
ioral research  has  been  using  forms  of  feedback  with 
success  for  the  past  two  decades.     The  pilot  study 
suggests  the  need  for  further  investigation  into  the 
effects  of  using  this  feedback  variable  in  the  coun- 
seling process  with  multiple  informants.     The  enhanced 
validity  of  the  reporting  of  tri- informants  has  been 
documented  and  seems  to  be  a  useful  method  of  obtaining 
a  more  accurate  picture  of  the  client's  behavior,  and 
will  be  the  essence  of  this  study.     Chapter  III  will 
take  these  concepts  and  construct  an  experimental 
research  with  them. 


Chapter  III 
Methodology 

In  general,  the  purpose  of  this  study  was  to  deter- 
mine the  effects  of  a  computerized  feedback  system  on 
groups  of  clients  in  a  community  mental  health  setting. 
Specifically,   the  goal  attainment  of  each  client  was  the 
criterion  variable.     The  feedback  instrument  was  the 
Automated  Tri- informant  Goal  Oriented  Notation  system 
(ATGON) ,    (Wilson    et  al.   1973).     The  three  informants 
included  the  client,  the  client's  nominated  significant 
other,  and  the  client's  counselor. 

This  was  an  experimental  study  using  treatment  (n=26) 
and  control  (n=27)  groups  and  a  quantitative  device  as 
an  index  of  change  (Campbell  and  Stanley,  1963) . 

The  basic  question  to  be  answered  involved  the  effi- 
cacy of  using  an  automated  feedback  system  (ATGON)  as  a 
treatment  variable  in  group  counseling. 

The  feedback  or  independent  variable  V7as  provided 
to  the  subjects  in  the  experimental  group  and  withheld 
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from  the  subjects  in  the  control  group.     The  groups 
were  compared  at  the  conclusion  of  the  experiment  to 
determine  if  there  were  statistically  significant  dif- 
ferences in  goal  attainment  as  measured  by  the  mean 
success  scores. 

The  independent  variable  was  the  computer  generated 
feedback  printouts   (ATGON)  and  an  individual  client's 
movement,  or  lack  of  movement,   toward  his  self -prescribed 
counseling  goals.     Each  experimental  client  received 
three  ATGON  printouts  based  on  his  own  evaluation,  and 
from  information  provided  by  both  his  counselor  and  his 
nominated  significant  other  relative  to  his  goals.  Each 
experimental  group  client  received  three  printouts, 
one  each  during  the  second,   fifth,   and  tenth  week  of 
the  treatment  period.     The  control  group  subjects  re- 
ceived counseling,  but  did  not  receive  these  three  print- 
outs. 

A  client's  printouts  were  generated  from  his  own 
goals  for  counseling  as  well  as  from  goals  selected  by 
his  counselor  and  his  nominated  significant  other. 

The  dependent  or  criterion  variable  was  the  actual 
success  score  as  computed  from  the  following  formula, 
(Wilson    et  al.   1973) . 

Success      Importance  (actual)  x  attainment  (actual)  +  10 
Score  =  Importance  (max.)  x  attainment  (max.)  +  10 

All  experimental  and  control  subjects  were  adminis- 
tered the  ATGON  instrument  as  a  pre-treatment  to  estab- 
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lish  a  baseline  of  their  initial  goals  for  counseling 
and  as  a  post- treatment  to  determine  whether  the  two 
groups  achieved  significantly  different  goal  attain- 
ment success  scores. 
The  subj  ects 

The  subjects  for  this  study  were  those  clients 
seeking  treatment  as  the  North  Florida  Community 
Mental  Health  Center,  a  community  based  walk-in 
clinic.     The  first  sixty  subjects  seeking  treatment 
at  the  clinic  after  the  commencement  of  the  study 
were  randomly  assigned  to  one  of  the  three  treat- 
ment or  three  control  counseling  groups.  Because 
of  this  procedure,   demographic  data  such  as  age, 
race,  and  sex  was  not  known  until  after  the  initial 
selection  procedure,  but  is  included  in  Chapter  IV. 

Each  of  the  three  experimental  and  three  control 
groups  was  composed  of  ten  subjects  each  yielding 
a  total  of  sixty  subjects  for  the  study.     As  a  result 
of  differential  mortality  this  number  was  lower 
(N=53) . 

All  subjects  were  asked  to  nominate  a  signifi- 
cant other  (usually  a  spouse  or  parent)   to  partici- 
pate in  the  experiment. 
Procedures 

The  time  frame  for  this  study  was  approximately 
fourteen  weeks.     The  first  four  weeks  were  used  for 
training  all  the  counseling  group  leaders  in  the 
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use  of  the  ATGON  instrument  as  a  counseling  tool.  ? 
The  three  experimental  group  leaders  were  taught 
methods  of  conducting  ATGON  feedback  sessions. 
This  amount  of  time  was  also  necessary  for  the 
counseling  groups  to  reach  the  desired  nximber  of 

clients.  The  ten  weeks  following  this  period  was  | 
the  treatment  time.     During  this  time  the  ATGON  j 

data  was  collected,  processed  by  the  computer,  and  | 

1 

f edback  to  the  experimental  group  members .  The 
overall  treatment  exposure  time  was  approximately 

twenty  hours .  j 

...  J 

Late  participants  were  assigned  alternately  . 
into  the  experimental  and  control  groups  provided 
entered  during  the  first  two  weeks  of  the  treat-  " 
ment  period.     Subjects  dropping  out  prior  to  the  •  ... 

fifth  week  were  not  included  in  the  final  data 
analysis. 
The  counselors 

The  experimental  and  control  group  counselors 
were  all  paid  staff  members  of  the  North  Florida 
Mental  Health  Center.     Their  experience  ranged  from 
one  and  one-half  to  five  years  with  a  mean  of  three 
years.     All  counselors  had  at  least  a  bachelor's 
degree  and  two  had  masters'   degrees.     They  were  all 
assigned  randomly  to  the  three  control  and  three  ex- 
perimental groups.     All  counselors  were  trained  and 
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briefed  on  the  use  of  the  ATGON  instrument.     A  written 
guide  was  provided  to  each  counselor  (appendix  A)  to 
aid  in  the  administration  and  standardization  of  the 
initial  goal  setting  interviews  and  the  subsequent 
posttesting. 
The  instrument 

The  Automated  Tri- informant  Goal  Oriented  Notation 
system  (ATGON)   (Wilson    et  al .  1973)  was  used  to  collect  ..j 
the  data  and  generate  the  feedback  information.     It  ' 
was  designed  to  provide  information  on  treatment  based 
on  movement  toward  counseling  goals  as  perceived  by 
the  client,  by  the  client's  significant  other,  and  by 
a  client's  counselor. 

Goals  were  identified  by  these  three  informant  i 
sources  and  coded  on  a  standardized  list  of  goals.  The  J 
ATGON  used  703  goal  statements  divided  into  six  domains:  " ■ 

(1)  medical,   (2)  symptom  alleviation,    (3)  self -concept ,  ] 
(4)  client-initiated  interactions,    (5)  other-initiated 
interactions,  and  (6)  disposition  goals. 

The  feedback  cycle  involved  three  stages.     Stage  i 
one  was  the  gathering  and  coding  of  the  goal  information 
obtained  from  the  three  sources  on  IBM  "mark- sense" 
optical  scan  forms.     Goals,   their  importance,  and 
methods  for  reaching  the  goals  were  recorded  by  the 
counselor  as  his  part  of  the  input.     Goals  and  their 
importance  were  obtained  from  the  client  and  from  his  ' 
nominated  significant  other  by  the  group  counselor. 
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Stage  two  of  the  procedure  was  a  collation  of  the  goals 
into  a  narrative  goal  statement  and  response  rating 
scale  for  each  of  the  three  informants  (appendix  B) . 
Each  rating  form  contained  individual  goals  printed 
over  two  Likert-type  scales.     One  was  a  five-point 
scale  of  the  perceived  importance  ranging  from  "very 
important"  to  "least  important."    The  other  was  a  six- 
point  scale  dealing  with  goal  attainment  ranging  from 
"much  further  from  goal"  to  "sufficient  attainment  of 
goal."     Following  goal  attainment  ratings,  success 
scores  were  calculated  using  the  success  score  formula 
previously  described  in  this  chapter. 

Because  of  the  success  scores'   common  demoninator 
it  was  used  to  make  comparisons  both  within  and  between 
groups.     Within  the  experimental  group  comparisons 
were  made  to  determine  whether  there  were  significant 
differences  among  the  three  informants'  perceptions 
of  a  particular  clients'  progress.     Between  group 
(experimental  vs.   control)  comparisons  were  made  to 
determine  overall  group  goal  attainment. 

Stage  three  of  the  procedure  involved  submitting 
respondents'  ratings  of  these  success  indices  to  a 
computer  program  which  produced  a  goal  by  goal  summary 
of  their  importance,  movement  toward  goal,  and  help- 
fulness of  methods.     Combining  these  summaries  with 
the  corresponding  goal  statements  produced  an  index  of 
client  change  (as  measured  by  perceived  movement  toward 


selected  goals)  and  were  used  to  assess  client  move- 
ment at  various  stages  of  treatment  as  well  as  behav- 
ioral feedback  for  the  treatment  process  itself.  Goal 
importance  and  helpfulness  of  methods  were  not  vari- 
ables considered  in  this  study. 
Empirical  issues  related  to  the  instrument 

The  ATGON  authors   (Wilson    et  al.   1973)  spent 
several  months  accumulating  goals  in  the  development 
of  the  instrument.     The  goals  were  derived  from  clients 
client's  significant  others,   counselors,   and  written 
documents.     The  original  list  of  1,500  goals  were 
analyzed  by  two  groups  of  professionals  and  reduced 
to  the  current  703  ATGON  goal  statements.     These  were 
subdivided  into  six  domains  printed  on  separate  IBM 
"mark-sense"  optical  scan  forms. 

The  feedback  printouts  were  printed  in  NOVEL. 
This  is  a  highly  specialized  computer  language  (Laska 
and  Klein,   1958)  used  to  summarize  ATGON  data  from  the 
IBM  forms,  and  printed  out  in  a  readable  language  for- 
mat (appendix  D) .     NOVEL  was  used  in  this  study  to 
produce  the  tri- informant ' s  "goal  method  selection 
note. " 

Wilson    et  al .    (1973)  did  a  validity  study  on  the 
ATGON  comparing  counselor's  ratings  of  client's  im- 
provement with  goal  success  scores.     The  counselor's 
ratings  were  obtained  at  the  time  of  each  client's 
discharge.     The  ratings  were  based  on  eight  areas  of 
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improvement:     (1)  family  relations,   (2)  social  relations, 
(3)  self -maintenance ,   (4)  antisocial  activities,  (5) 
use  of  leisure  time,    (6)  character  change,    (7)  general 
S3miptom  improvement,   and  (8)   self-confidence.  The 
ratings  were  averaged  to  yield  an  overall  improvement 
index.     This  index  was  then  correlated  with  the  cumu- 
lative success  scores  of  the  clients  based  on  the  ATGON 
goal  attainment  ratings.     The  improvement  ratings 
correlated  with  the  success  scores  from  the  staff  at 
.659  (N=27,  £<^.01);  from  the  client  at  .048  (N=30, 
£-NS) ,  and  from  the  significant  other  at   .618  (N=31, 
£  <^.01).     The  counselor  and  the  significant  other 
maintained  a  relatively  high  correlation.     The  authors 
suggested  this  to  be  a  result  of  the  difference  in 
belief  between  what  the  clients  viewed  as  success 
and  what  the  counselors  preceived  as  client  improve- 
ment . 

For  furth  er  validation,    (Wilson    et  al .   1973)  a 
congruency  study  betv/een  the  three  informant  groups' 
ratings  of  goal  improvement  was  analyzed  with  the  fol- 
lowing results.     Cumulative  success  score  congruency 
between  the  three  informant  groups  showed  that  the 
counselor  and  the  client  correlated  at   .504  (N=50, 
£<^.01);   the  counselor  and  the  significant  other 
correlated  at   .510  (N=43,  £  <^.01)  and  the  client  and 
the  significant  other  correlated  at   .281  (N=50,  £<'  .05), 


Thus,   it  can  be  observed  that  the  counselor  and  the 
client  were  in  relatively  high  agreement  with  similar 
results  for  the  counselor  and  the  significant  other. 
The  client  and  his  significant  other  agreed  least  on 
his  success  score  based  on  his  goal  attainment. 

In  another  validation  study,  Wilson    et  al.  (1973) 
used  the  Treatment  Effectiveness  Scale  (TES)  to  validate 
the  ATGON.     This  is  a  device  designed  to  measure  pro- 
gress in  treatment  and  was  developed  independently 
from  the  goal  attainment  rating  scale.     The  TES  was 
administered  to  both  clients  and  their  significant 
others.     The  four  variables  on  the  TES  were:     (1)  staff 
concern  and  competence,    (2)   satisfaction  with  treat- 
ment outcome,    (3)  satisfaction  with  self,  and  (4) 
satisfaction  with  interpersonal  relations.  These 
summed  scores  produced  an  index  of  treatment  effective- 
ness which  was  correlated  with  ATGON  success  scores. 
Although  the  N  was  relatively  small  (12) ,   the  r  was 
approximately  .50  for  the  client  and  his  significant 
other  which  lends  support  for  the  validity  of  the  ATGON. 

In  a  study  of  inter-rater  reliability,  (Wilson 
et  al.   1973)  taped  interviews  of  actual  clients  and 
their  nominated  significant  others  were  goal  coded  by 
staff  members.     Two  independent  raters  listened  to  the 
counseling  tapes  and  coded  the  ATGON  forms.  Their 
inter-rater  reliability  was   .94  across  judges.  Their 
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reliability  over  time  (three  months)  was   .93  for  one 
rater  and  .96  for  the  other  rater. 

Investigating  the  congruency  between  informant's 
ratings  of  goals  held  in  common  for  ratings  made  at 
approximately  the  same  time,  Wilson    et  al.  (1973) 
found  a  relatively  high  degree  of  similarity  betx^een  the 
three  informant  groups.     For  analysis  they  used  (1) 
correlation  betv;een  the  three  informants,    (2)  average 
absolute  difference  between  the  three  informant's 
success  scores,  and,    (3)  a  frequency  distribution  to 
determine  informant  agreement   (N=35) .  Correlation 
between  staff  and  significant  other  success  scores 
was  .58  on  98  common  goals  checked  for  the  client. 
Correlation  between  staff  and  client  and  his  signifi- 
cant other  was  .50  on  156  common  goals  checked  for 
the  client.     The  average  absolute  difference  for  the 
three  informants  ranged  from  .70  to  .80  across  all 
goals.     A  frequency  distribution  to  determine  congru- 
ency between  attainment  ratings  for  the  three  infor- 
mants revealed  that  each  of  the  informant  pairs  (client- 
counselor,  client-significant  other,  counselor-signifi- 
cant other)  had  perfect  agreement  45-50%  of  the  time 
and  agreement  that  varied  only  one  scale  point  or 
less  80-85%  of  the  time. 

From  the  above  research  it  is  felt  that  the  valid- 
ity, reliability,  and  norming  of  the  ATGON  instrument 
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was  adequately  supported  for  the  purposes  of  this  study. 
The  hypotheses 

The  hypotheses  stated  in  the  null  form  for  this 
study  were: 

Hypothesis  1:     No  significant  difference  would  exist 
between  the  mean  success  scores  of  goal  attainment  post- 
counseling  of  the  experimental  and  control  group  subjects. 

Hypothesis  2:     No  significant  difference  would  exist 
between  mean  success  scores  of  experimental  and  control 
group  subjects'   goal  attainment  as  perceived  by  their 
respective  significant  others. 

Hypothesis  3:     No  significant  difference  would  exist 
between  mean  success  scores  of  experimental  and  control 
subjects'  goal  attainment  as  perceived  by  their  respec- 
tive counselors. 
Data  analysis 

The  success  scores  computed  from  the  clients, 
counselors,  and  the  significant  others  in  the  exper- 
imental and  control  groups  were  analyzed  in  accordance 
with  the  ATGON  one-way  analysis  of  variance  program 
package.     Each  of  the  three  informant  groups  were 
pretested  and  posttested,   the  results  appear  in 
Chapter  IV. 

The  alpha  level  set  throughout  the  study  was  .05 
(two  tailed) .     It  was  felt  that  this  was  an  acceptable 
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level  of  risk  for  a  Type  1  error  to  be  made  in  this  study. 

A  one-way  analysis  of  variance  was  run  over  the  six 
groups  as  a  pretest  to  ascertain  if  there  were  any  sig- 
nificant differences.     There  were  no  significant  pre- 
treatment  differences  between  groups  on  the  dependent 
measure.     Treatment  effects  were  analyzed  with  one-way 
analysis  of  variance  for  pretreatment  to  posttreatment 
change  scores.     Significant  differences  were  found  and 
a  Tukey's  HSD  test  (Kirk,  1968)  was  conducted  making 
all  pairwise  comparisons  among  means. 
Limitations 

This  section  was  an  attempt  to  state  possible 
problems  in  this  study  and  to  make  reasonable  allow- 
ances where  such  unavoidable  problems  arose.  Limita- 
tions were  anticipated  and  choices  had  to  be  made  to 
ensure  a  strong  study  on  one  hand  and  a  practical  study 
on  the  other. 

A  possible  source  of  difficulty  in  this  study  was 
the  pretesting  procedure  itself.     The  pretesting  was 
designed  to  collect  the  baseline  data  concerning  the 
goals  of  subjects  in  both  the  experimental  and  control 
groups.     This  could  have  cued  subjects  in  the  control 
group  to  goals  they  had  not  previously  considered,  thus 
producing  a  reactive  effect.     This  awareness  could  have 
interfered  with  the  analysis  of  differences  between 
the  experimental  and  control  groups.     To  counter  this 
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effect,  goals  themselves  were  not  variables  in  this 
study.     The  achievement  of  goals,  as  measured  by  success 
scores  x\^ere  the  only  ones  taken  into  account. 

"Teaching  the  instrument"  may  have  proved  problematic 
in  this  study.     Because  of  this,  the  focus  was  on  behav- 
ioral change  and  the  group  leaders  were  warned  to  avoid 
teaching  the  instrument. 

The  population  was  limited  to  those  individuals 
seeking  help  in  a  community  mental  health  setting. 
This  limited  generalizations  of  the  data  to  persons 
seeking  treatment  and  must  be  considered  as  a  factor 
in  the  external  validity. 
Feedback  model  cycle 

Beginning  with  the  admission  of  a  client  to  the 
study  there  was  initial  goal  selection  procedure  to  set 
a  baseline  for  behavior  change.     This  established  a 
client's  goals  for  himself,   the  counselor's  goals  for 
the  client,  and  the  significant  other's  goals  for  the 
client  (appendix  D)  . 

Goal  selection  information  was  then  fed  into  the 
computer  which  printed  out  response  rating  scales  of 
all  goals   (appendix  B) .     These  were  used  as  feedback 
material  in  the  group  counseling  sessions.     The  three 
experimental  informant  groups  completed  the  response 
rating  scales  which  were  then  fed  into  the  computer 
to  produce  the  goal  selection  summary  (appendix  C) . 
The  goal  seleciton  summary  was  then  fedback  into  the 


group  in  counseling  sessions  with  the  counselor. 

The  complete  cycle  was  run  on  the  second,  fifth, 
and  tenth  week  of  the  experimental  period.     On  the 
tenth  week  success  scores  were  computed  to  determine 
the  goal  attainment  value  for  each  goal  selected  by 
the  three  informants. 


Chapter  IV 
Results  and  Discussion 


The  purpose  of  this  study  was  to  test  the  effects  . 
of  using  a  tri- informant  feedback  procedure  in  a  group 
counseling  setting.     The  three  informat  sources  were  the 
counselors,   the  clients  and  the  client's  significant 
others. 
Demographics 

Of  the  60  clients  originally  selected  for  the  study, 
53  completed  the  treatment  period  and  were  posttested. 
Twelve  subjects  dropped  out  during  the  first  two  weeks 
of  treatment.     As  was  originally  proposed,   12  alternates 
were  selected  to  replace  these  dropouts.     Four  more 
clients  dropped  out  prior  to  the  fifth  week  and  were 
not  posttested.     Those  subjects  were  not  used  in  the 
final  data  analysis.     In  addition,   two  more  clients 
dropped  out  after  the  fifth  week.     These  two  were  in- 
cluded in  the  final  data  analysis  as  set  forth  in 
Chapter  III. 

The  mean  age  of  the  53  subjects  in  the  study  was 
27.5.     Females 'mean  age  was  32.5  and  males' 26. 5.  Ages 
ranged  from  16  to  46  years. 
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Nineteen  males  (35.1%)  and  34  females  (46.9%) 
comprised  the  groups.     Racial  composition  was  27  Cau- 
casians (50%) ,  25  blacks  (49%) ,  and  one  American 
Indian  (1%) . 

The  subjects  were  randomly  assigned  to  one  of 
three  treatment  or  three  control  groups.     There  were 
ten  subjects  in  each  of  the  six  groups. 
Statistical  findings 

No  significant  pretreatment  differences  among 
groups  were  found  on  the  dependent  variable  of  the 
ATGON.     Thus,   treatment  effects  were  analyzed  for  dif- 
ferences between  pretreatment  and  posttreatment  scores. 
As  was  specified  earlier,  mean  success  scores  were 
examined  as  the  dependent  variable. 

A  fixed-effects  ANOVA  model  was  used  since  all 
treatment  levels  about  which  inferences  were  drawn 
were  included  in  the  experiment.     The  one-way  analysis 
of  variance  for  unequal  cells  was  used  because  of  the 
differential  mortality  rates  among  the  six  groups.  To 
test  the  hypothesis  that  all  population  means  were 
equal  an  F-ratio  was  utilized.     If  significant  F-ratios 
were  found  they  were  followed  by  the  Tukey's  HSD  test 
for  making  pairwise  comparisons  among  means  in  the  three 
control  and  three  experimental  groups. 

The  data  resulting  from  a  comparison  of  the  client' 
pre  and  posttest  scores  are  summarized  in  Table  1.  An 
F-ratio  of  6.25  was  found  to  be  significant  at  the  .05 


Table  1 


Summary  of  Data 
and  Analysis  of  Variance 
of  Client's  Posttest 
Success  Scores 


Ci  C2  C3  El 

n:  10  9  8  9 

M:  .36        .38        .38  .30 


Source  of 

Variation  df  MS 


Between  Groups        5  .05 
Within  Groups        48  .008 


<.05 


Table  2 


Differences  Among  Means 
of  Client's  Posttest 
Success  Scores 


X6  X5  X3  X2  Xi  X4 


X6=.45  _        .05        .07        .07  .09  .15-^ 

X5=.40  _        .02        .02  .04  .10 

X3=.38                                             .00  .02  .08 

X2=.38  _  .02  .08 

Xl=.36  _  .06 

X4=.30   


Note .     Means  1,   2,  and  3  are  control  groups  and  4, 
5,   and  6  are  experimental  groups 
df=5/49,   "£  <  .05 
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level.      Therefore,  this  was  followed  by  Tukey's  HSD  com- 
parison of  all  six  means.     Table  2  shows  the  results  of 
this  comparison.     Of  the  six  group  means  only  group  4  an 
experimental  group,  differed  significantly  from  group  6, 
also  an  experimental  group. 

Since  both  group  4  and  group  6  were  experimental 
groups,  no  significant  differences  were  observed  between 
control  and  experimental  groups.     Also,  no  clear  direc- 
tionality could  be  deduced  from  the  data. 

Hypothesis  1  stated:     No  significant  differences 
would  exist  between  the  mean  success  scores  of  goal 
attainment  post-counseling  of  the  experimental  and  con- 
trol group  subjects. 

This  hypothesis  is  accepted  in  light  of  the  em- 
pirical evidence  found  in  the  client's  data  in  this  study. 

The  results  of  the  significant  others  mean  success 
scores  ANOVA  appears  in  Table  3.     A  significant  F-ratio 
was  found  at  the  . 05  level  and  this  was  followed  by  a 
pairwise  comparison  of  all  group  means.     The  results 
of  this  comparison  are  listed  in  Table  4.  Statistically 
significant  differences  were  found  between  the  success 
score  means  of  group  2  and  groups  1,   4,  and  5.  Groups 
1  and  2  were  control  and  groups  4  and  5  were  experimental 
groups,  yielding  a  mixture  of  differing  results.  Also 
group  mean  6  differed  significantly  from  group  means  1 
and  4.     Mean  1  was  a  control  group  and  mean  4  was  an  ex- 
perimental group.     Further  inconsistencies  developed  in 


Table  3 


Summary  of  Data 
and  Analysis  of  Variance 
of  Significant  Others' 
Success  Scores 


Ci  C2  C3  El 

n:  10  9  8  9 

M:  .36        .40        .39  .36 


Source  of 

Variation  df  MS 


Between  Groups        5  .30 
Within  Groups        48  .009 


Table  4 


Differences  Among  Means 
of  Significant  Others' 
Success  Scores 


^2         X6         X3         X5         Xi  X4 

X2=-40    .00        .01        .03*  .04-  .04* 

X5=.40    .00        .01  .03*  .04* 

X3=.39    .02  .03*  .03* 

X5=.37  _  .01  .01 

Xi=.36  _  -01 

X4=.36   


Note .     Means  1,  2,  and  3  are  control  groups  and  4, 
5,  and  6  are  experimental  groups. 
df=5/49,  *£  <^.05 


comparing  the  differences  between  group  mean  3,  a  control 
group,  and  group  means  1  and  4,  a  control  and  experimental 
group,  respectively. 

Hypothesis  2  stated:     No  significant  differences  would 
exist  between  mean  success  scores  of  experimental  and 
control  group  subjects'  goal  attainment  as  perceived  by 
their  respective  significant  others. 

This  hypothesis  is  accepted  because  of  the  mixed 
findings  resulting  from  the  significant  others'  success 
scores.     The  results  are  not  conclusive  and  a  clear  dif- 
ferentiation cannot  be  made  separating  the  control  from 
experimental  group  results. 

Table  5  shows  the  results  of  the  analysis  of  vari- 
ance of  the  counselor's  posttest  mean  success  scores. 
Statistical  significance  was  found  at  the  .05  level. 
Pairwise  differences  among  means  of  the  counselor's 
success  scores  appear  in  Table  6.     Statistical  dif- 
ferences existed  between  the  treatment  and  the  control 
groups  consistently.     All  three  experimental  groups 
differed  significantly  from  all  three  control  groups 
in  a  positive  direction. 

Hypothesis  3  stated:     No  significant  differences 
would  exist  between  mean  success  scores  of  experimental 
and  control  subjects'  goal  attainment  as  perceived  by 
their  respective  counselors . 


38 


This  hypothesis  was  rejected  in  favor  of  the  rival 
hypothesis  that  the  treatment  and  control  groups  would 
differ  significantly. 
Discussion  of  results 

The  purpose  of  the  analysis  of  data  is  to  derive 
meanings  by  which  the  results  of  the  investigation  can 
be  correctly  interpreted.     Part  of  this  task  is  to  find 
if  the  facts  confirm  the  hypothesis  around  which  this  : 
study  is  founded.     Another  part  concerns  the  reliabil- 
ity of  the  results.     If  the  results  are  reliable  the 
predictive  value  of  the  findings  can  be  derived  through 
the  generalization  process. 

In  this  study  the  results  ranged  from  the  rejection 
of  Hypothesis  3  to  the  acceptance  of  Hypotheses  1  and  2. 
The  significance  of  this  findings  is  that  it  shows  coun- 
selors observing  significant  change  which  is  not  in 
agreement  with  the  observations  of  the  client  and  their 
significant  other.     The  evidence  was  clear  to  permit  the 
rejection  of  the  null  hypothesis  that  the  control  and 
treatment  groups  differed  post- treatment  as  perceived  by 
the  counselors.     The  evidence  was  also  clear  that  the  null 
hypotheses  regarding  the  clients  and  the  significant 
others  could  not  be  rejected.     These  latter  finding  does 
not  necessarily  reflect  on  the  value  of  the  study.  It 
may  be  a  case  of  insufficiency  of  data,   insufficiency  of 
treatment  exposure  time  or  lack  of  sensitivity  of  the 
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Table  5 


Summary  of  Data 
and  Analysis  of  Variance 
of  Counselor's  Posttest 
Success  Scores 


Cl  C2  C3  El  E2  E3 


10  9  8  9  9  8 


M: 


.39 


.36 


.32 


.52 


.53 


.55 


Source  of 
Variation 


df 


MS 


F 


Between  Groups 


5 


.08 


20.0'"' 


Within  Groups 


48 


.004 


.05 
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Table  6 


Difference  Among  Means 
of  Counselor's  Posttest 
Success  Scores 


H  X5  X4  Xi  X2  X3 

X5=.55  _        .02        .03        .16*  .19*  .23* 

X5-.53  _        .01        .14*  .17*  .21* 

X4=.52    .13*  .16*  .20* 

Xi=.39  _  .03  .07 

X2=.36  _  .04 

X3=.32  _ 


Note.     Means  1,   2,   and  3  are  control  groups  and  4, 
5,   and  6  are  experimental  groups. 
df=  5/49,  *p  <^  .05 
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instrument.     Verification  of  any  hypothesis  can  only  be 
approximate  regardless  of  the  amount  of  supporting  data. 
These  data  support  the  hypothesis  in  terms  of  degree 
rather  than  in  an  absolute  sense.     It  is  felt  that  this 
data  must  be  viewed  conservatively  and  not  be  extended 
beyond  the  limitations  of  the  context. 
Weaknesses  in  data  collection 

The  group  counselors  involved  in  this  study  set 
the  initial  goals  with  the  clients.     This  should  have 
been  done  by  independent  raters.     Many  of  the  clients 
later  became  members  of  the  same  interviewing  coun- 
selor 's  treatment  group.     This  was  a  limitation  because 
of  the  effects  of  the  counselor's  previous  knowledge 
and  his  vested  interest  in    that  particular  client. 
It  would  have  been  more  advantageous  to  have  the  goal 
setting  interview  conducted  by  an  independent  counselor 
rather  than  one  of  the  group  leaders  participating  in 
the  investigation. 

The  non-humanistic  quality  of  this  type  of  computer 
feedback  proved  to  be  adverse  to  many  of  the  group  coun- 
selors and  clients  alike.     The  dissatisfaction  resulting 
from  dealing  with  a  computer  manifested  itself  in  many 
forms .     Some  participants  turned  in  forms  late  and  some 
not  until  repeated  requests  to  do  so.     There  was  an 
underlying  resistance  to  this  type  of  systematic  approach 
to  dealing  with  individuals  and  their  problems. 


Chapter  V 
Summary  and  Conclusion 

The  problem  in  this  study  was  the  counseling  value 
of  specific  information  fedback  to  clients  in  a  group 
counseling  milieu.     Information  concerning  a  client's 
goals  and  his  movement  toward  or  away  from  those  goals 
was  examined  for  their  counseling  effect.     Because  of 
the  possible  biased  validity  and  reliability  of  the  coun 
selor  and  client  as  a  source  of  information,  a  third 
informant  was  added.     This  third  informant,  nominated 
by  the  client,  provided  information  concerning  the 
client's  behavior  that  occured  out  of  the  counseling 
session.     It  was  felt  that  multiple  sources  of  infor- 
mation would  give  a  more  complete  and  accurate  picture 
of  a  client's  overall  behavior. 

Behavioral  information  was  obtained  from  the 
client,   the  client's  nominated  significant  other, 
and  the  client's  counselor.     This  information  was 
coded  and  recorded  on  IBM  "mark- sense"  forms.  This 
system  was  devised  by  Wilson,   et  al.    (1973)  and 


42 


43 


termed  Automated  Tri- informant  Goal  Oriented  Notation 
or  ATGON.     Behavioral  baseline  data  was  gathered  at 
the  commencement  of  the  ten  week  study  as  a  pretest 
and  at  the  termination  as  a  posttest.     Data  was  also 
gathered  at  the  seven  week  point  and  fedback  into  the 
counseling  group. 

Three  treatment  and  three  control  groups  initally 
composed  of  10  clients  each  were  selected  from  a  walk- 
in  community  mental  health  population.     Of  the  60 
subjects  beginning  the  experiment  53  finished,  26 
experimental  and  27  control. 

After  a  short  training  period,   the  six  group 
counselors  were  asked  to  set  the  initial  goals  for  the 
ten  persons  in  their  group  and  also  help  in  the  goal 
setting  with  the  significant  others  relative  to  their 
group.     Although    the  significant  others  did  not  di- 
rectly participate  in  the  group  they  did  participate 
indirectly  since  their  goal  summaries  were  used  as 
part  of  the  feedback  module. 

The  research  design  was  a  pretest-posttest  control 
group  comparison.     The  experimental  groups  received 
group  counseling  plus  the  ATGON  module  while  the 
control  groups  received  only  group  counseling.  The 
individuals  vzere  randomly  assigned  to  one  of  the  three 
control  or  three  experimental  groups.     A  one-way  anal- 
ysis of  variance  was  computed  after  the  initial  goal 
setting.     No  significant  pretreatment  differences  were 
found  between  the  six  groups. 
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Significant  posttreatment  differences  were  found. 
A  pairwise  comparison  of  all  group  means  was  run  to 
determine  where  the  differences  occurred.  Findings 
from  the  study  were  mixed.     Differences  were  examined 
within  the  six  groups,  the  significant  others,  and  the 
counselors.     They  hypotheses  stated  that  no  differences 
would  exist  between  pre  and  posttesting  based  on  success 
scores  of  goal  achievement.     Conversely,   the  research 
hypotheses  were  in  fact  looking  for  significant  change 
scores  between  pretesting  and  posttesting. 

Of  the  three  hypotheses  only  number  3  could  be 
rejected  with  certainity.     Hypotheses  1  and  2  were 
supported  by  the  evidence  of  the  research.  Hypotheses 
1  and  2  stated  that  there  would  be  no  significant  dif- 
ferences between  client's  and  significant  other's  pre- 
test and  posttest  success  scores,  respectively.  Neither 
of  these  could  be  clearly  rejected  based  on  the  results. 
Only  Hypothesis  3,   stating  that  there  would  be  no  sig- 
nificant differences  between  counselor's  pretest  and 
posttest  success  scores,  was  rejected  in  favor  of  the 
rival  hypothesis.     Although  all  three  groups  perceived 
change  from  pre  to  posttesting  only  the  counselors 
showed  significant  change.     Findings  showed  a  positive 
direction  throughout  the  results. 
Validity 

The  value  of  research  of  this  type  is  its  appli- 
cability to  the  actual  counseling  situation.     The  level 
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of  generalizability  of  the  findings  answers  the  question 
of  external  validity.     The  relevance  of  these  findings 
beyond  the  confines  of  the  experiment  must  be  interpreted 
with  caution. 

The  subjects  in  this  experiment  could  be  considered 
representative  of  a  community  mental  health  center  walk- 
in  population.     To  generalize  beyond  that  population  in 
that  setting  would  be  outside  the  limits  of  the  research. 

The  statistical  results  of  the  study  showed  that  of 
the  three  informant  groups,  only  the  counselors  showed 
differences  across  all  experimental  groups  compared 
with  the  control  groups.     The  clients  and  their  sig- 
nificant others  did  not  show  significantly  different 
results  between  pretesting  and  posttesting  across  groups. 
Does  this  indicate  that  the  client  changes  were  only 
preceptable  by  the  sophisticated  counselors?     Or  possibly, 
that  the  counselors  were  more  likely  to  have  seen  client 
change  because  they  were  looking  for  it  and  the  change 
became  a  self-fulfilling  prophecy?     In  this  study,  since 
change  was  observed  across  the  three  experimental  groups 
and  not  so  across  the  three  control  groups,  the  infer- 
ence can  be  drawn  that  the  counselors  were  in  fact  ob- 
serving change.     The  degree  of  change  might  be  in  question, 
but  most  certainly  positive  change  was  observed  by  the 
counselors.     The  original  tenet  of  this  study  was  that 
automated  feedback  would  result  in  significant  alteration 
of  behavior.     It  may  be  submitted  that  the  individual's 
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behavior  that  was  significantly  altered  was  that  of  the 
counselor,  or,  at  least,  his  perceptions. 

Another  issue  that  might  support  this  theory  is 
the  behavioral  consistency  of  the  client.  Specifically, 
if  the  counselors  noted  behavioral  change  in  the  clients, 
why  didn't  the  clients  themselves  hold  a  similar  view? 
And,   further,  why  did  not  the  significant  others  notice 
this  change  outside  the  group  setting?     These  questions 
should  be  answered  in  further  research  in  this  area. 

One  of  the  questions  to  be  answered  by  this  study 
was  the  effect  of  this  automated  feedback  on  a  client's 
goal  attainment.     Results  were  inconclusive  here.  Some 
clients  moved  toward  goal  attainment  and  some  moved 
away  while  some  remained  static.     A  number  of  possibl- 
ities  could  explain  these  results.     Not  enough  treat- 
ment exposure  time  may  have  produced  this  effect  and 
could  be  remedied  by  a  longer  experimental  treatment 
time.     Insensitivity  of  the  instrument  to  discern  min- 
ute amounts  of  behavioral  discrepancies  could  explain 
it,  although  gross  changes  were  seen  by  some  clients. 
One  reasonable  explanation  could  be  individual  dif- 
ferences.    Clients  may  not  have  been  as  well  equipped 
to  discern  individual  differences  as  accurately  as 
counselors.     The  counselors,  by  training  alone,  were 
relatively  homogeneous  and  could  have  been  cued  to 
perceive  small  amounts  of  behavior  differences. 
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A  second  question  in  this  research  was  whether  this 
feedback  would  help  a  client  focus  on  specific  problems 
thus  enabling  him  to  achieve  his  personal  counseling 
goals.     Although  this  was  reported  by  the  clients  and 
their  significant  others  it  was  not  supported  by  the 
data.     Perhaps  an  extension  of  this  study  over  time  or 
a  follow-up  to  determine  how  well  the  clients  remembered 
their  counseling  goals  would  appropriately  answer  this 
question. 

The  third  question  was  the  effects  of  the  other 
informant's  goals,   that  of  the  counselor  and  the  sig- 
nificant others,  on  a  client's  goal  attainment.  Aside 
from  the  reports  of  the  clients  that  they  were  more 
aware  of  more  diverse  goals  for  them,   the  effect,  as 
measured  by  the  criterion,  proved  nil. 
Recommendations  for  further  research 

Since  two  of  the  subject  types,   clients  and  their 
significant  others,  did  not  show  significant  differences 
this  should  be  looked  into  extensively.     Perhaps  a 
longer  treatment  period  than  the  ten  weeks  used  here. 
More  frequent  group  meetings  could  produce  different 
results  in  a  follow-up  study.     The  groups  in  this  study 
met  twice  weekly  for  an  hour  each  meeting.     This  could 
be  extended. 

The  significant  others  did  not  attend  the  group 
meetings.     A  number  of  them  requested  to  do  so  and  many 
clients  wanted  to  include  them.     The  feedback  effect 


might  have  proved  more  potent  had  the  significant  others 
been  in  the  group  counseling  sessions.     This  would  have 
permitted  a  more  immediate  and  direct  form  of  feedback 
than  the  indirect  form  used  here. 

It  is  further  recommended  that  the  ATGON  format  be 
shortened.     Because  of  the  large  number  of  goal  state- 
ments many  subjects  complained  about  the  time  involved 
in  enumerating  and  rating.     The  task  proved  arduous  for 
many  and  could  have  led  to  inattention  and  indifference 
in  enumerating  and  rating. 

Finally,  a  more  hiimanistic  approach  should  be  inves- 
tigated.    The  feeling  of  being  computerized  prevaded 
jnany  of  the  groups.     Even  though  there  was  joking  about 
being  "spindled,  bent,  and  multilated"  there  was  an  ' 
underlying  resentment  toward  the  format.     Although  it 
would  prove  more  statistically  difficult  to  analyze, 
simple  goal  statements  in  the  client's  own  words  are 
recommended. 


Appendix  A 
Goal  setting  interview  guide  for  the 
counselors 
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Guide  to  goal  setting 
interview  with  client 
(adapted  from  Aikin  and  Lund,  1974) 

1.  State  purpose  of  interview: 

a.  to  find  out  what  you  want  to  get  out  of  treat- 
ment here. 

b.  to  provide  a  communications  channel  among  coun- 
selors,  clients,  and  significant  others. 

c.  to  research  the  use  of  tri-inf ormant  feedback 
in  groups. 

2.  Elicit  goal  statements  from  the  client  in  an  open- 
ended  fashion. 

a.     emphasize  working  on  goals. 

3.  Clarify  goal  statements  so  they  may  be  coded  on  forms 

4.  Record  only  goals  on  forms,  one  page  at  a  time. 

5.  Obtain  the  importance  rating  for  each  goal  and 
level  of  functioning. 

6.  Get  name,  address,  and  phone  number  of  significant 
other. 

7.  Terminate  interview  (remind  subjects  in  the  exper- 
imental groups  that  they  will  be  doing  this  three 
more  times  and  subjects  in  the  control  groups  that 
they  will  be  doing  this  once  more  in  the  course  of 
ten  weeks) . 

8.  Discard  any  pages   (except  page  1)  that  have  no 
goals  marked  on  them. 


9.     Fill  in  names,  numbers,   and  methods  on  remaining 
pages . 

10.  Check  to  make  sure  all  necessary  information  is 
included  (i.e.,  goals,   importance  ratings,  level 
of  functioning,  names,   date,   client  and  staff 
numbers,  sex,  treatment  mode,  rater  type,  and 
page  niimber)  . 

11.  Repeat  steps  5,  6,   9,  10,  and  11  for  counselor 
goal  setting. 

12.  Follow  procedure  in  steps  1-11  for  significant 
other  interview,   except  for  completing  the 
methods  list. 


Appendix  B 
Sample  ATGON  response  rating  scale 
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Response  rating  scale 


Person  setting  goals:  Date  goals  set: 

1      Client  Date  of  response  rating: 

.   Type  of  rater  (0)  Staff  Sex  (1)  Male 

Person  rating  response  (Number)  (Name)  

Evaluation  time  period 
Team  (3) 

37      Goal  1008  -  Increase  self-confidence  concerning 

ability  to  achieve 

Importance  (1)  very     (2)  quite     (3)  somewhat  (4)  less 

(5)  least 

Movement  toward  goal 

(1)  much  further     (2)  further     (3)  no         (4)  somewhat 
from  from         change  closer 

(5)  much  (6)  sufficient 

closer  attainment 

Helpfulness  of  methods    very    quite     some    not        not  N/A 

what  very    at  all 

64      91  Group  one  12  3  4  5  6 

56  Confrontation  12  3  4  5  6 

17  Reassurance  12  3  4  5  6 


Appendix  C 

Sample  summary  of  ATGON  response  rating  scale 
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Summary  of 
Response  Rating 


Patient  #303662 
Team- -30 
Rater- -patient 


Date 
Goals  set 


Interviewer  303762 


Goal--Increase  self-regard 

Importance-quite    movement  toward  goal-much  closer 

teaching  very  helpful 

role  modeling  not  at  all  helpful 

token  therapy  not  at  all  helpful 

routine  industrial  therapy  somewhat  helpful 

small  group  therapy  somewhat  helpful 

Goal-Increase  independence 

Importance- somewhat  movement  toward  goal- somewhat  closer 


teaching 
role  modeling 
token  therapy 

routine  industrial  therapy 
small  group  therapy 


very  helpful 
not  at  all  helpful 
somewhat  helpful 
very  helpful 
quite  helpful 


Goal-Develop  greater  responsibility  for  self 

Importance-quite    movement  toward  goal-much  closer 


teaching 
role  modeling 
token  therapy 

routine  industrial  therapy 
small  group  therapy 


somewhat  helpful 

somewhat  helpful 

somewhat  helpful 

somewhat  helpful 

somewhat  helpful 


Goal-Develop  skills  in  decision  making 

Importance-quite  movement  toward  goal- somewhat  closer 


teaching 
role  modeling 
token  therapy 

routine  industrial  therapy 
small  group  therapy 


quite  helpful 
quite  helpful 
not  very  helpful 
somewhat  helpful 
quite  helpful 


Goal-Become  more  goal  directed 

Importance- somewhat  movement  toward  goal- somewhat  closer 


teaching 
role  modeling 
token  therapy 

routine  industrial  therapy 
small  group  therapy 


not  very  helpful 
not  very  helpful 
somewhat  helpful 
somewhat  helpful 
quite  helpful 


Appendix  D 

Sample  goal  method  selection  note  feedback 
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Goal  method  selection  note 

This  note  should  be  included 
in  the  client's  chart 

Client  ID- 
Goals  were  set  for    .  ATGON 

program,  on    by   .     The  client 

is  currently  assigned  to  daycare  and  regularly  attends 
the  treatment  program.     Her  level  of  functioning  is 
seen  as  fair.     The  prognosis  is  seen  as  also  fair. 
Symptoms : 

She  needs  to  reduce  or  suppress  her  withdrawn  behav- 
ior and  depressive  behavior.     There  seems  to  be  a  ten- 
dency, which  should  be  suppressed  or  reduced,   to  leave 
group  therapy. 
Self-concept  changes: 

In  general,   this  individual's  self-regard  should 
be  increased,   self-confidence  in  the  area  of  ability  to 
work  should  be  increased.     She  should  be  better  able  to 
accept  authority.     The  need  has  been  indicated  for  this 
client  to  increase  her  independence.     This  client  is 
to  demonstrate  greater  flexibility.     Increased  emotional 
stability  is  hoped  for.     Feelings  of  anxiety  must  be 
handled  more  appropriately. 

The  staff  will  use  group  three,   small  group  therapy, 
routine  industrial  therapy  and  activities  group  to 
accomplish  these  self -concept  goals. 
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